A toolkit of resource-sensitive, multimodal widgets
نویسنده
چکیده
Behaviour Widget State of current widget In Outside system: User input to widget Out Feedback Manager: Abstract, media independent feedback requests Feedback Manager Widget Media used by widget In Abstract Behaviour: Abstract, media independent feedback requests Control System: Commands regarding output media Out Module Mapper(s): Abstract, media specific feedback requests Module Mapper Widget Media specific settings for widget In Feedback Manager: Abstract, media specific feedback requests Control System: Commands regarding output media options Out Rendering Manager: Abstract, media specific, parameterised feedback requests Rendering Manager Global Rules for transforming feedback requests In Module Mapper(s): Abstract, media specific, parameterised feedback requests Control System: Transformation rules Output Media: Transformation flags Out Output Media: Abstract, media specific, Chapter 6: Design of a Toolkit of Multimodal Widgets 119 parameterised feedback requests Control System: Transformation commands Output Media Global Concrete renderings of abstract feedback requests In Rendering Manager: Abstract, media specific, parameterised feedback requests. Out Rendering Manager: Transformation flags Control System: Abilities and rule definitions. Outside System: Concrete feedback. Control System Global Rule definitions All widgets Sensor & output media options and abilities In Rendering Manager: Transformation commands Output Media: Abilities and rule definitions. Sensors: Options and changes in context. Control UI: Transformation commands Out Feedback Manager: Output media to add/remove Module Mapper: Output media option to add/remove Rendering Manager: Transformation rules Sensors: Sensor commands Control UI: User options Sensors Global Context information In Control System: Sensor commands Out Control System: Options and changes in context Control UI Global User Settings In User options Out Transformation commands Figure 6.4 Summary of toolkit architecture objects. For each object its scope (global or widget), knowledge and communication links are described. The knowledge about the presentation is distributed throughout the toolkit. The abstract widget behaviour only has knowledge about the current state of the widget, but has no knowledge of the presentation being used. This means that the requests generated by the abstract widget are abstract requests which are independent of presentational information. This conforms to Design Guideline 2. The module mappers, on the other hand, do have knowledge of the presentational specific information for the widget. Every widget has one module mapper for every output module being used. The module mappers, therefore, provide the link between the abstract requests and the concrete feedback provided by the output modules. A summary of the way the different objects in the toolkit communicate with each other is given in Appendix E. Chapter 6: Design of a Toolkit of Multimodal Widgets 120 6.4.2 Scenario 1: Modifying Audio Feedback in a Noisy
منابع مشابه
Supporting Context Driven Change in a User Interface
This paper discusses the design of a toolkit of user interface components (widgets) that change their interaction method based on the context. The types of change supported range from relatively simple "look & feel" transformations through radical alteration of interaction modality. These changes are made dynamically and are based on resource availability (e.g., display area), global demands on...
متن کاملCaring, Sharing Widgets: A Toolkit of Sensitive Widgets
Although most of us communicate using multiple sensory modalities in our lives, and many of our computers are similarly capable of multi-modal interaction, most human-computer interaction is predominantly in the visual mode. This paper describes a toolkit of widgets that are capable of presenting themselves in multiple modalities, but further are capable of adapting their presentation to suit t...
متن کاملEfficiency of Speech Recognition for Using Interface Design Environments by Novel Designers
Previous studies on usability of graphical design-widgets, like menus and buttons, proposed the use of speech and non-speech (earcons and auditory icons) for solving their usability problems. In this paper we investigate speech as an input metaphor to enhance learnability, or the ability to use a system with no prior knowledge, in order to design interfaces using a multimodal interface design t...
متن کاملTwo New Modalities for ARIA
Accessibility of rich internet applications is ensured by ARIA and assistive technology supporting this additional mark-up. We propose MM-ARIA for the integration of multiple types of assistive technology while supporting multimodal interaction. The Dojo toolkit’s calendar widget is an example of a complex, non-standard widget requiring ARIA mark-up. MM-ARIA generates grammars for speech recogn...
متن کاملThe X Toolkit: More Bricks for Building User-Interfaces or Widgets for Hire
Primitives for application-level user interface construction facilities currently under development at M.I.T. Project Athena are described. The design philosophy of the X Toolkit and associated widgets and some of the practical implications are discussed.
متن کامل